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PDA has wireless modem for remote control via the internet 



FIELD OF THE INVENTION 

The invention relates in particular to remote control of consxmier electronics 
(CE) equipment. 
5 ' 

BACKGROUND ART 

Remote control units are widely known. An example is the Pronto 
manufactured by Royal Philips Electronics. The Pronto is.a so-called universal 
programmable remote control unit. It enables storing the IR codes of practically any existing 
10 consumer electronics (CE) apparatus. The Pronto has an LCD with touch screen functionality 
as a user-interface. The control functionalities of the Pronto can be fully customized by the 
user him/herself. The Pronto communicates with nearby CE equipment using infra-ed (IR) 
radiation. 

1 5 SUMMARY OF THE INVENTION 

The invention takes the concept of "remote control" within the CE context a 
step further. The inventors propose to provide fully remote control to the user regardless of 
the distance between the equipment to be controlled and the user. The inventors also propose 
a two-way communication between the remote control and the equipment to be controlled. 

20 To this end, the invention provides an information processing system that has 

a handheld computing device, e.g., a PDA,(Personal Digital Assistant) with a user-interface 
and a wireless modem coupled to the handheld. The wireless modem enables communication 
with a server via a data network such as the Internet. A control network is coupled between 
the server and controllable equipment. The handheld is now capable of functioning as a 

25 wireless remote control device for the equipment via the Internet and the server. The system 
may comprise a video camera together with hardware and software to create a formatted still 
image suitable for being displayed on the handheld device. The user can now instruct 
retrieval of a still image from the server via the Internet. This application serves as, e.g., a 
security system that enables the remote user to monitor his/her front porch, or to monitor a 
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Child by way of a remote (or fall-back) baby-sit. The user-accessibility of equipment is 
guaranteed by the ubiquity of the Internet, thus enabling to expand the range of control and 

monitoring capabilities for a mobile user. 

Incorporated by reference herein are the following patent documents: 

5 .US serial no.60/156,087 (Attorney docket PHA 23,783P) fUed 9/24/99 for Martin Freeman 
and Bonghan Cho for REMOTE INITIATES RETRIEVAL OF CONTROL 
CONFIGURATION. This document relates to a programmable remote control umt that is 
capable of initiating retrieval of a control configuration from a storage device external to the 
unit The unit comprises a memory to store the retrieved control configuration; a display for 

10 display of icons representing the configuration; and a touch screen for entering a selection 
based on the icons displayed. The storage device is a component a CE apparams. By stonng 
or backing-up the control configuration for a specific apparatus in the apparatus itself the 
remote is made truly universally progranunable. 

- U S serial no. 09/160,490 (attorney docket PHA 23,500) filed 9/25/98 for Adrian Turner, 
15 Simon Pearce, David Eves and Allan Tinuns for CUSTOMIZED UPGRADING OF 
INTERNET-ENABLED DEVICES BASED ON USER-PROFILE, and 
. U S serial no. 09/189.535 (attorney docket PHA 23,527) filed 1 1/10/98 for Eugene Shteyn 
for UPGRADING OF SYNERGETIC ASPECTS OF HOME NETWORKS, both of which 
relate to a server system that maintains a user profile of a particular end-user of consumer 
20 electronics network-enabled equipment .and a data base of new technical features for this type 
of equipment. If there is a match between the profile and a new technical feature, and the user 
has indicated he/she is willing to receive the information about updates or sales offers, the 
user gets notified via the network of the option to obtain the feature. Synergy is detected 
between pieces of equipment of the user in order to notify him/her of fiirther possibilities of 
25 using or expanding his/her equipment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is explained by way of example and with reference to the 
accompanying drawings, wherein Fig.l is a block diagram of a system in the invention. 
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PREFERRED EMBODIMENTS 

The invention is explained below within the context of two examples. A first 
example is the use of the remote control via the Internet to turn on and turn off a lamp. The 
second example relates to retrieving an image from a home server. 
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Fig. 1 is a block diagram of a system 100 of the invention. System 100 



comprises a hand-held device 102 such as a personal digital assistant (PDA) ,e.g., a Palmlllx 
manufactured by 3COM or a Windows CE-based handheld, that is connected to a data 
network 106, e.g., the Internet, via a wireless modem 104. Modem 104 is, for example, a 
5 Minstrel or a Ricochet. The Minstrel marketed by Novatel Wireless is a two-way wireless 
modem for a PDA that lets the user browse the Web and receive email, among other things. 
In a more general sense, a wireless modem like the Minstrel or Ricochet provides the 
handheld device with an IP address that can be used by any type of application that uses the 
Internet for communication (within limitations of throughput, latency and coverage). The 

1 0 Minstrel uses a technology referred to as Cellular Digital Packet Data (CDPD) that is 

supported by the cellular service providers. Web surfing is limited to a CDPD speed cap of 
19.2-kbps. The Ricochet from Metricom has a faster connect rate, in the 28.8K-bps range, but 
it is supported in only three metropolitan centers (the San Francisco Bay area, Seattle and 
Washington). Note that the remote control functionality in the system of the invention does 

15 not require a high data rate. The information commtmicated is limited in size. The data rate in 
this example is approximately 9,600 Baud. System 100 further has a server 108, an X-10 
controller 110, an X-10 switch module 1 12 and a lamp 1 14. X-10 is a communications 
protocol for control of electrical devices. The protocol is designed for communications 
between X-10 transmitters and X-10 receivers which communicate on standard household 

20 wiring 1 16, X-10 is mentioned here as an example. Alternative control mechanisms are 
feasible that do not use the power supply lines, such as CEBus, I2C, IR (through an IR 
blaster), etc. Switch 1 12 connects lamp 1 14 to main power supply 116 under control of 
controller 1 10. Controller 1 10 in turn gets its control input from server 108. 



25 functionality, and a client application 120. Client application 120 controls the creation of soft 
buttons on display 118. Assume that application 120 is activate on PDA 102. When user 
activates an ON-button on display 118, application 120 uses wireless modem 104 to send a 
command via the Internet 106 to server 108. 



1995 based on the NCSA httpd Web server. The name "Apache" stems from the fact that it 
was developed from existing NCSA code plus various patches. Accordingly, it was referred 
to as a patchy server, hence the name Apache Server. The Apache has become the world's 



PDA 102 has a display 1 1 8 with a touch screen or graphical tablet 
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Server 108 comprises in this example a PC hardware running an Apache web 
server 122. The Apache is a public-domain Web server. Its first version was developed in 
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most popular Web server because of its high performance, sophisticated features, and 
because of the fact that its source code is available for free. 

Server 108 further comprises software modules 124 that comprise CGI scripts 
run by Apache server 122. CGI stands for "Common Gateway Interface" and is as 
5 specification for transferring information back and forth between a Web server and an 
application. CGI is part of the HTTP protocol 

Apache server 122 running on PC 108 interprets the command received from 
PDA 102 over the Internet 106. The interpretation mechanism uses, e.g., a data base on PC 
108, wherein each specific command received is linked to a specific action. The data base 
10 can be fiilly customized by the user. The command in this example is interpreted as an action 
to turn on lamp 1 14. To this end, PC communicates with controller 1 1 0, e.g., via RS232, and 
instructs the latter to issue a conunand to switch 1 12 to turn lamp 1 14 on. Switch 1 12 
receives the command and connects lamp 1 14 with power lines 116. Similarly, when the user 
thereafter presses an OFF-button on PDA 102, client application 120 sends a coiresponding 
15 command via modem 104 to PC 108 via the Internet 106. Apache server 122 interprets the 
command and instructs controller 1 10 to let svsdtch 1 12 turn off lamp 1 14. 

System 100 fiirther comprises a server 126, herein referred to as the Reliable 
Home Server (RHS) arid a camera 128. RHS 126 may be a component within server 108 or a 
separate low-cost server, as in this example. Alternatively, web server 122 and scripts 124 
20 can be components of server 126. RHS 1 26 comprises hardware and software to retrieve \ 
images from a video source, in this example, a still image from video camera 128. Client ' 
application 120 provides a soft button "VIEW" that, when pressed, let application 120 send a 
command via modem 104 and the Internet 106 to server 108. Apache server 122 running on 
PC 108 receives the conunand, interprets it and instructs RHS 126 to retrieve a still image 
25 and return it to Apache server 122. The latter converts the format of the still image suitable 
for display on GUI 1 1 8 of PDA 1 02 and then stores the formatted image in a data base on PC 
108. The user presses another soft button "UPDATE' created by client application 120, The 
associated command gets send via modem 104 and the Internet 106 to PC 108. Apache server 
122 receives the command, interprets it, and accordingly retrieves the stored image from the 
30 database and returns it to PDA 102 via common Internet protocols. PDA 102 then displays 
the image on GUI 118 under control of client application 120. 

Above, the remote control over the Internet has been explained with reference 
to some conceptually simple examples. It is clear that other and more sophisticated scenarios 
can be implemented using the invention. For example, a recordmg device such as a VCR or 
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TiVo can be programmed from anywhere in the world when the user realizes that he/she has 
forgotten or was unable to set the device to record a favorite TV program. Within this 
context, also see U.S. serial 09/283,545 (attorney docket PHA 23,633) filed 4/1/99 for 
Eugene Shteyn for TIME-AND LOCATION-DRIVEN PERSONALIZED TV, herein 
incorporated by reference. As another example, the user may tum on the central heating and 
turn on the lights at home and in the garden while returning home by car late at night. As 
another example, the user may program or activate the sprinkler installation in the garden at 
home while at work or traveling. 
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CLAIMS: 



1 An information processing system (100) comprising: 

- a handheld device (102) for providing a ixser-interface; 

- a wireless modem (104) for coupling the handheld device to a data network (106); 

- a server (108; 126) for communicating with the handheld device through the modem via the 

data network; and 

- a controllable CE sub-system (1 14) coupled to the server; 
wherein: 

- the handheld device is enabled to function as a user-controllable remote control unit for the 
CE equipment (1 14) via the data network and the server. 

2 The system of claim 1 , wherein: 

- the handheld device comprises a client software application (120) for enabling the device to 
send a user-input to the server; and 

. the server comprises software (124) for interpreting the user-input received via the data 
network and for issuing a corresponding command to the CE equipment based on the user- 

input. 



3 ^ The system of claim 1 , wherein: 

. the system comprises an apparatus (128) for capturing information content; 
20 - the apparatus is coupled to the server; 

. the handheld device is enabled to receive the information content under user control from 
the server via the data network and the wireless modem. 

4. The system of claim 3, wherein: 

25 - the information content comprises a still image; 
- the handheld device comprises a GUI; 

. the server has software to format the still image as to enable display on the GUI upon 
sending the formatted information content to the handheld via the data network upon user 
request. 
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5. A method of enabling a user to remotely control a CE apparatus (114), the 
method comprising: 

- enabling the user to send a command from a handheld device (102) via a wireless modem 
5 (1 04) to a data network (1 06); 

- enabling a server (108; 126) coupled to the apparatus to receive the conmiand from the data 
network for effecting control of the CE apparatus (114). 

6. For use on an information processing system (100), wherein the system 
1 0 comprises: 

- a handheld device (102) for providing a user interface; 

- a wireless modem (104) for coupling the handheld device to a data network (106); 

- a server (108; 126) for communicating with the handheld device via the modem over the 
data network; 

15 - controllable CE equipment (114; 128) coupled to the server; and wherein: 

- the handheld device is enabled to function as a user-controllable remote control unit for the 
CE equipment via the data network and the server: 

a client application (1 20) for running on the handheld device for processing user-input and 
sending the user-input via the data network to the server. 

20 

7. The client application of claim 6, wherein: 

- the handheld device comprises a GUI (118); and 

the client application is capable of enabling a user to retrieve from the server content 
information captured at the CE equipment. 

25 

8. For use on an information processing system, wherein the system comprises: 

- a handheld device (102) for providing a user-interface (118); 

- a wireless modem (104) for coupling the handheld to a data network (106); 

- a server (1 08; 126) for communicating with the handheld device via the modem over the 
30 data network; 

- a control network (110; 126)) coupled to the server; 

- controllable CE equipment (1 14,1 10; 128)coupled to the server; and wherein: 

- the handheld device is enabled to function as a user-controllable remote control unit for the 
CE equipment via the data network and the server: 
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software (124) for running on the server to interpret a user-input received from the handheld 
over the data network and to generate a control command for the CE equipment. 

9 The software of claim 7, wherein the software is user-programmable for 

associating a specific user-input to a specific control command for the CE equipment. 

10, The software of claim 8, wherein: 

- the handheld has a GUI (1 1 8), and 

the software is capable of processing content information captured at the CE equipment for 
communicating the content information to the handheld via the data network. 

11. A remote control device (102&104) comprising: 

- a user-interface (118) for enabling a user to enter an input; and 

- a wireless modem (104) for enabling remote control via the Internet upon the input 
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